Papers by Dong Won Lee
No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures (2020.findings-emnlp)
Copied to clipboard
| Challenge: | a study of spoken language and co-speech gestures shows that it is important to model the long tail of the language-gesture distribution. |
| Approach: | They propose a method that combines adversarial learning with importance sampling to strike a balance between precision and coverage. |
| Outcome: | The proposed method outperforms state-of-the-art methods for gesture generation. |
Global Reward to Local Rewards: Multimodal-Guided Decomposition for Improving Dialogue Agents (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for asynchronous dialogue agents only use a single global score at the end of the session. |
| Approach: | They propose a method for aligning an LLM-based dialogue agent for long-term social dialogue . they use local implicit feedback to decompose a human-provided global Explicit reward . |
| Outcome: | The proposed approach improves the turn-level utterance generation across conversational metrics compared to baseline methods. |
Aligning Dialogue Agents with Global Feedback via Large Language Model Multimodal Reward Decomposition (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a large language model is used to decompose global feedback into a lightweight reward model. |
| Approach: | They propose a large language model based reward decomposition framework for dialogue agents . they use a frozen large language modeling framework to decompose global feedback . |
| Outcome: | The proposed framework infers fine-grained local rewards from a single session-level feedback signal. |